Method for representing an environment by means of a display unit arranged on a person and visible for the person

ABSTRACT

A method represents an environment via a display unit arranged on a person and visible for the person as a display image within the scope of a simulation. The simulation is carried out in an interaction environment, wherein a number of actuatable interaction elements are arranged in the interaction environment. An interaction environment image capture, depicting the interaction environment, is created by use of a first image capturing unit arranged on the person or relative to the person. A position of the person is determined in the interaction environment and based on the position of the person an environment image is provided. An image mask is provided which depicts the individual interaction elements contained in the interaction environment image capture and is represented in the display image. The interaction environment image capture and the environment image are superimposed using the image mask and then displayed on the display unit.

The invention relates to a method for displaying an environment by meansof a display unit arranged on a person and visible for the person as adisplay image in the context of a simulation according to claim 1 and asimulation arrangement according to claim 13.

Various methods and devices for representing an environment as a displayimage for a person in the context of a simulation are known from theprior art. For this purpose, for example, portable display deviceshaving display screens, for example head-mounted displays, are used,which are either partially transparent, so that the environment can bepartially perceived or shown through the display, while other areas areoverlaid by virtual screens. Such devices are known, for example, fromUS 2018204478 A1, WO 2012039877 A1, and US 2012206452 A1. Such displaydevices can be combined with input devices such as gloves havingintegrated sensors or input devices held in the hand, in order to givethe user the option of having influence on the simulation. WO 2016079476A1 discloses, for example, that virtual control elements are shown forthe user who can operate them virtually.

However, in the methods and devices known from the prior art, theinteraction options for the user with the simulation are restricted.Furthermore, for example, with partially transparent display media,visible artifacts can occur in the simulation in the field of view ofthe user, since the depiction of the environment is only overlapped witha virtual representation and the field of view of the user is thusrestricted. Furthermore, in the methods known from the prior art,virtual objects can only be shown at predetermined positions in the realspace or image.

The object of the invention is therefore to provide a remedy in thisregard and to provide a method and a device for representing anenvironment by means of a display unit arranged on a person and visiblefor the person as a display image in the context of a simulation, whichensure the most unrestricted possible field of view for the userwithout, for example, artifacts resulting from a superposition, whichoccur with transparent display units, and enable a user to interact withthe simulation or influence the simulation in a particularly realisticmanner.

The invention achieves this object with a method according to claim 1.It is provided according to the invention that to represent anenvironment by means of a display unit arranged on a person and visiblefor the person, in particular by means of a set of 3D glasses, as adisplay image in the context of a simulation,

-   -   the simulation is carried out in an interaction environment, in        particular a cockpit, wherein a number of actuatable interaction        elements are arranged in the interaction environment and wherein        the simulation is influenceable by means of the interaction        elements,    -   at least one interaction environment recording depicting at        least parts of the interaction environment, in particular two        interaction environment recordings, is created by means of at        least one first image recording unit arranged on the person or        relative to the person,    -   the position of the person in the interaction environment is        ascertained and an environment image from a virtual and/or real        environment is provided in dependence on the position of the        person,    -   wherein an image mask is provided,    -   wherein individual positions on the at least one interaction        environment recording, the environment image, the image mask,        and the display image are associated with one another,    -   wherein an item of interaction environment distance information        between the person and the interaction environment is        ascertained and the interaction environment distance information        is associated position by position, in particular pixel by        pixel, with the individual image areas of the at least one        interaction environment recording, and/or    -   at least one image parameter value, in particular an image        parameter value selected from image sharpness value, brightness        value, contrast value, color value, of the individual image        areas of the at least one interaction environment recording is        ascertained position by position, in particular pixel by pixel,        and    -   the image mask is created in such a way that the depiction of        the individual interaction elements contained in the at least        one interaction environment recording is represented in the        display image by checking    -   whether the object area of the interaction environment depicted        in the respective image area of the at least one interaction        environment recording exceeds a predetermined interaction        environment distance threshold value, and/or        -   whether the respective image area of the at least one            interaction environment recording exceeds at least one image            parameter threshold value predetermined for the interaction            environment, in particular at least one image parameter            threshold value selected from image sharpness threshold            value, brightness threshold value, contrast threshold value,            color threshold value,    -   the at least one interaction environment recording and the        provided environment image are superimposed pixel by pixel using        the image mask, and    -   the image superimposed in this way is displayed as the display        image on the display unit.

It is advantageously possible by way of these features according to theinvention to select the depiction of parts of the interactionenvironment, for example, within a predetermined distance around theperson, for example, on which the first image recording unit isarranged, or, for example, on the basis of its surface quality, andmerge it with a provided environment image, for example, a provideddepiction of a virtual environment, to form a single display image forthe user. This means that, for example, the hands of a user and theinteraction elements, such as a steering wheel or a shift lever, whichare in range of the hands, can be displayed in the display image so thatthe realism of the simulation is improved and the user receives the mostrealistic possible perception of space in the simulation. In this way,it is also possible to prevent the user from feeling unwell during thesimulation, which can occur if the spatial perception of the person isdisturbed during the simulation.

Furthermore, for example, the hands of the user or the interactionelements are not shown at predetermined positions in space, but ratherare merged in dependence on the position of the person in theinteraction environment using the image mask with the environment imageto form a single display image and are visible at arbitrary positions inthe display image, which result from the position of the person. Thisposition in the display image can therefore advantageously change, forexample, when the person moves in the interaction environment, forexample, turns the head and inclines the upper body.

A method according to the invention is particularly advantageous forteaching persons, for example, to deal with greatly varying devices orfor training the correct behavior in, for example, greatly varyingtraffic situations.

An interaction environment refers hereinafter to a real environment inwhich the simulation is carried out, for example, a cockpit of anautomobile or a desk having a seat. Objects by means of which the usercan influence the simulation are referred to as interaction elements,for example, a steering wheel, shift lever, control buttons, rockerswitches, a controller, etc. Such interaction elements are arranged inthe interaction environment, for example fixedly integrated. A displayimage refers to the image which is displayed for the user by the displayunit, for example a set of 3D glasses. A simulation environment isunderstood hereinafter as a real or virtual environment which is to besimulated for the user, for example, a real or virtual street, if thecontrol, for example, of an automobile is to be simulated for the user.

An image mask is understood hereinafter as a 2D image, a 3D model, orcoherent image or spatial positions which define a shape, surface orlines or beams, or combinations thereof, which can be used to mergevirtual or real image recordings originating from different sources,such as the interaction environment recording and the environment image,to form a single display image.

Image parameter values are understood hereinafter as alphanumericvariables, which define specific image properties or properties ofindividual image points or image areas of an image recording. Thisrelates to static (a posteriori) properties, which define an existingimage (for example brightness value), and also a priori properties,which are defined by the image recording unit and influence the imagerecording (for example f-stop of a camera). Image parameter values canbe, for example, an image sharpness value, brightness value, contrastvalue, or color value.

An image sharpness value is understood hereinafter as a value whichdescribes the detail recognition of image contents. This includes bothphysical sharpness, thus the edge sharpness of individual imagesections, which supplies a statement about the punctiform transitionfrom light to dark, and also the subjective sharpness impression, independence on image optimization, resolution, artifacts, and otherfactors.

Brightness value is understood hereinafter as the amount of white of animage area or the measured value of the illumination or luminance, whichresults due to ambient light.

Contrast value is understood hereinafter as a ratio between thebrightest and darkest image areas of a recording or a ratio of thedifferent brightnesses of adjacent image areas of a recording inrelation to one another.

Color value is understood hereinafter as the amount of red, green, andblue components of a specific pixel or image area of a recording.

To be able to represent greatly varying simulation environments for auser in a display image in greatly varying simulation applications in aparticularly simple manner and to enable this so as to provide aparticularly realistic simulation for the respective simulationenvironment, it can be provided that

-   -   for the provision of the environment image    -   at least one simulation environment recording depicting at least        parts of a simulation environment, in particular two simulation        environment recordings, is created by means of at least one        second image recording unit arranged in the simulation        environment,    -   wherein the position of the second image recording unit in the        simulation environment is ascertained, and    -   wherein the environment image from the simulation environment is        provided in dependence on the position of the person and the        position of the second image recording unit in such a way that        the recording areas of the first image recording unit and the        second image recording unit are coupled to one another,    -   wherein the image mask is provided in such a way that individual        positions on the at least one interaction environment recording,        the at least one simulation environment recording, the image        mask, and the display image are associated with one another,        wherein    -   an item of simulation environment distance information between        the at least one second image recording unit and the simulation        environment is ascertained and the simulation environment        distance information is associated with the individual image        areas of the at least one simulation environment recording        position by position, in particular pixel by pixel,    -   and/or    -   at least one image parameter value, in particular an image        parameter value selected from image sharpness value, brightness        value, contrast value, color value, of the individual image        areas of the at least one simulation environment recording is        ascertained position by position, in particular pixel by pixel,        and    -   wherein the image mask is created by additionally checking    -   whether the object area of the simulation environment depicted        in the respective image area of the at least one simulation        environment recording exceeds a predetermined simulation        environment distance threshold value    -   and/or    -   whether the respective image area of the at least one simulation        environment recording exceeds at least one image parameter        threshold value predetermined for the simulation environment, in        particular at least one image parameter threshold value selected        from image sharpness threshold value, brightness threshold        value, contrast threshold value, color threshold value, and    -   wherein the at least one interaction environment recording and        the provided environment image from the simulation environment        are superimposed pixel by pixel using the image mask to create        the display image.

In this way, an environment image from a real environment, i.e., thesimulation environment, can be provided, wherein the recording areas ofthe first and the second image recording unit are coupled to one anotherin such a way that the viewing direction of the user in the interactionenvironment corresponds to the viewing direction of the image recordingunit in the simulation environment. It is thus advantageously possiblethat a user of the simulation has the impression as if he were actuallylocated in the simulation environment and can interact by means of theinteraction elements in the interaction environment with the simulationenvironment.

A simulation environment refers hereinafter to a real environment whichis to be simulated for the user.

“Coupled” recording areas are to be understood in this context to meanthat the recording area of the first image recording unit and therecording area of the second image recording unit are in relation to oneanother in such a way that the movement or translation and rotation ofthe respective one image recording unit results in a translation androtation of the respective other image recording unit.

A particularly exact superposition of the interaction environmentrecording with the provided environment image can be achieved if theimage mask is created in that the distance information created positionby position, in particular pixel by pixel, and/or the image parametervalue ascertained position by position, in particular pixel by pixel, inparticular the sharpness value and/or brightness and/or contrast valueand/or color value, is used to ascertain, in particular by thresholdvalue comparison, whether and/or to what extent the at least oneinteraction environment recording and/or the provided environment imageare used for the creation of the display image.

Hard transitions and edges in the display image and camera artifacts andartifacts which are to be attributed to varying exposure can thusadvantageously be avoided, and objects in the interaction environment,which are not to appear in the display image, can be removedparticularly reliably.

A particularly exact item of distance information for the creation ofthe image mask can be obtained if the distance information isascertained on the basis of the interaction environment recording,and/or possibly on the basis of the simulation environment recording,and/or

-   -   if the distance information is ascertained by means of a        distance sensor arranged on the person, in particular the        display unit, and/or possibly on the second image recording        unit,    -   wherein it is provided in particular that a distance image of        the interaction environment, and/or possibly the simulation        environment, is created by means of the distance sensor.

A further improvement of the image mask can be achieved if, in the casethat multiple different distance sensors, which are based in particularon different physical measurement principles, are provided,

-   -   a change of the distance sensor, the distance information of        which is used to create the image mask, is performed according        to predetermined criteria, in particular in dependence on the        time of day, the solar radiation, the ambient lighting, surface        properties of objects in the interaction environment and/or the        simulation environment.

A particularly exact distance value, which can be obtained without theuse of additional distance sensors, can be provided if the items ofdistance information provided by multiple distance sensors are used asthe foundation for the creation of an overall image mask. In this way,it is possible to ascertain items of distance information directly onthe basis of the depiction of the interaction environment, i.e., theinteraction environment recording.

A further improvement of the image mask or a more reliable removal ofobjects which are not to be visible in the display image can be achievedif the distance information is provided by an algorithm on the basis ofthe at least one interaction environment recording, and possibly thesimulation environment recording, which algorithm is based ontechnologies of machine learning, in particular artificial neuralnetworks and/or support vector machines,

-   -   wherein it is provided in particular that a neural network is        trained on the basis of training data, wherein the training data        comprise recordings, the image pixels of which are linked to        items of distance information.

Such an embodiment of a method according to the invention advantageouslyenables items of distance information in the interaction environment orthe simulation environment to be provided by an algorithm, which isbased on technologies of machine learning, for example artificial neuralnetworks and/or support vector machines. If a neural network is used toprovide the items of distance information, for example, this neuralnetwork can be trained on the basis of training data, wherein thesetraining data comprise recordings, for example, from interactionenvironments or simulation environments S, the image pixels of which arelinked to items of distance information. If an interaction environmentrecording or a simulation environment recording is subsequently suppliedto the neural network, the neural network can thus associate items ofdistance information with the individual image areas.

An especially time-saving and computing power-saving creation of adisplay image can be achieved if an envelope object is defined withrespect to the interaction environment, and/or possibly the simulationenvironment, for the check of whether an object area of the interactionenvironment depicted in an image area of the at least one interactionenvironment recording, and possibly an object area of the simulationenvironment depicted in an image area of the at least one simulationenvironment recording, exceeds a predetermined distance threshold value.

A further improvement of the exclusion of objects which are not to bedisplayed in the display image can be achieved if depictions of objectsare ascertained in the at least one interaction environment recording,and/or possibly the at least one simulation environment recording as anenvironment image from the simulation environment, the surface of whichhas a predetermined superficially recognizable property, in particular apredetermined brightness or color or a predetermined pattern, and

-   -   if the depictions of the objects ascertained in this way are not        used for the superposition of the at least one interaction        environment recording and the environment image.

A particularly realistic display image can be obtained if asuperposition zone is predetermined in a predetermined distance areaaround the predetermined distance threshold value, in particular aroundthe envelope object, and

-   -   if upon the superposition of the at least one interaction        environment recording and the provided environment image, in        particular the environment image of the simulation environment,        in each case the transparency of those image points of the at        least one interaction environment recording and the environment        image is predetermined, in particular according to a        predetermined function, which depict object areas within this        superposition zone,    -   wherein it can be provided in particular that those image points        of the at least one interaction environment recording and the        provided environment image, which depict object areas, the        distance of which corresponds to the distance threshold value,        are predetermined to be equally transparent upon the        superposition.

By way of such a selection of the transparency of the interactionenvironment recording and the environment image, a particularlyrealistic display image can be achieved, in which undesired interfacesor edges in the superposition area are not visible.

A further improvement of the display image can be achieved if the imagemask is smoothed in the superposition area of the at least oneinteraction environment recording and the provided environment image, sothat the individual pixel values of the image mask define a ratio inwhich the relevant pixel values of the at least one interactionenvironment recording and the provided environment image aresuperimposed on one another.

A particularly realistic display image can be achieved if the exposureand/or f-stop of the first image recording unit and/or the second imagerecording unit is adapted to objects, the distance of which exceeds thepredetermined distance threshold value.

The object of the invention is furthermore to provide a simulationarrangement for the representation of an environment as a display imagein the context of a simulation, using which the method according to theinvention can be carried out, and which enables a particularly realisticinteraction in the context of the simulation for a user.

This object is achieved by the features of claim 13. It is providedaccording to the invention here that the simulation arrangementcomprises the following components:

-   -   a display unit arrangeable on a person, in particular a set of        3D glasses, which is designed to display received display images        for a person,    -   an interaction environment, in particular a cockpit, wherein a        number of actuatable interaction elements are arranged in the        interaction environment, wherein the simulation is influenceable        by means of the interaction elements,    -   at least one first image recording unit arrangeable on a or        relative to a person, which is designed to create at least one        interaction environment recording, in particular two interaction        environment recordings, at least of parts of the interaction        environment at a respective recording point in time, and    -   a control and processing unit in data communication with the        display unit and the first image recording unit, wherein the        control and processing unit is designed    -   to ascertain the position of a person in the interaction        environment and provide an environment image from a virtual        and/or real environment in dependence on this position,    -   to activate the at least one image recording unit to create        interaction environment recordings,    -   to ascertain or process an item of distance information between        the person and the interaction environment and to associate the        distance information with the individual image areas of the at        least one interaction environment recording position by        position, in particular pixel by pixel, and/or    -   to ascertain at least one image parameter value, in particular        an image parameter value selected from image sharpness value,        brightness value, contrast value, color value, of the individual        image areas of the at least one interaction environment        recording position by position, in particular pixel by pixel,        and    -   to create an image mask in such a way that the depiction of the        individual interaction elements contained in the at least one        interaction environment recording is represented in the display        image by checking    -   whether the object area of the interaction environment depicted        in the respective image area of the at least one interaction        environment recording exceeds a predetermined interaction        environment distance threshold value,    -   and/or    -   whether the respective image area of the at least one        interaction environment recording exceeds at least one image        parameter threshold value predetermined for the interaction        environment, in particular at least one image parameter        threshold value selected from image sharpness threshold value,        brightness threshold value, contrast threshold value, color        threshold value,    -   to associate individual positions on the at least one        interaction environment recording, the environment image, the        image mask, and the display image with one another,    -   to superimpose the at least one interaction environment        recording and the provided environment image pixel by pixel        using the image mask, and    -   to transmit the image superimposed in this way as a display        image to the display unit.

A particularly realistic simulation of an interaction with a realsimulation environment can be achieved if the simulation arrangement forproviding the environment image comprises at least one second imagerecording unit arranged in a simulation environment, which is designedto create at least one simulation environment recording, in particulartwo simulation environment recordings, depicting at least parts of asimulation environment,

-   -   wherein the control and processing unit is in data communication        with the second image recording unit, and    -   if the control and processing unit is designed    -   to ascertain the position of the second image recording unit in        the simulation environment,    -   to activate the at least one second image recording unit to        provide the environment image from the simulation environment in        dependence on the position of the person in the interaction        environment and the position of the second image recording unit        in such a way that the recording areas of the at least one first        image recording unit and the at least one second image recording        unit are coupled to one another,    -   to ascertain or process an item of distance information between        the at least one second image recording unit and the simulation        environment and to associate the distance information with the        individual image areas of the at least one simulation        environment recording position by position, in particular pixel        by pixel,        -   and/or    -   to ascertain at least one image parameter value, in particular        at least one image parameter value selected from image sharpness        value, brightness value, contrast value, color value, of the at        least one simulation environment recording position by position,        in particular pixel by pixel, and    -   to create the image mask by additionally checking    -   whether the object area of the simulation environment depicted        in the respective image area of the at least one simulation        environment recording exceeds a predetermined simulation        environment distance threshold value    -   and/or    -   whether the respective image area of the at least one simulation        environment recording exceeds at least one image parameter        threshold value predetermined for the simulation environment, in        particular at least one image parameter threshold value selected        from image sharpness threshold value, brightness threshold        value, contrast threshold value, color threshold value,    -   to associate individual positions on the at least one        interaction environment recording, the simulation environment        recording as an environment image, the image mask, and the        display image with one another, and    -   to superimpose the at least one interaction environment        recording and the provided environment image from the simulation        environment pixel by pixel using the image mask to create the        display image.

A particularly exact distance value can be provided if the simulationarrangement comprises at least one distance sensor arrangeable on aperson, in particular the display unit, and/or an image recording unit,wherein it is provided in particular that the at least one distancesensor is designed to create a distance image of the interactionenvironment and/or the simulation environment.

A further improvement of the accuracy of the provided distanceinformation can be achieved if the simulation arrangement comprisesmultiple different distance sensors, in particular based on differentphysical measurement principles, and

-   -   if the control and processing unit is designed to select a        distance sensor for the provision of distance information for        the creation of the image mask according to predetermined        criteria, in particular in dependence on the time of day, the        solar radiation, the ambient lighting, surface properties of        objects in the interaction environment and/or the simulation        environment.

A further improvement of the possibility for a realistic interactionwith interaction elements and influencing the simulation can be ensuredif the control and processing unit is designed to carry out a methodaccording to the invention.

Further advantages and embodiments of the invention result from thedescription and the appended drawings.

Exemplary embodiments of the invention which are particularlyadvantageous but are to be understood as nonrestrictive areschematically shown hereinafter on the basis of the appended drawingsand described by way of example with reference to the drawings.

In the schematic figures:

FIG. 1 shows a representation of an interaction environment havinginteraction elements and a person or a user in the context of a firstexemplary embodiment of a method according to the invention,

FIG. 2 shows an exemplary embodiment of an interaction environmentrecording of the interaction environment from FIG. 1 ,

FIG. 3 shows an exemplary embodiment of a provided environment image inthe context of the first exemplary embodiment,

FIG. 4 shows an exemplary embodiment of a display image in the contextof the first exemplary embodiment,

FIG. 5 shows a representation of an interaction environment havinginteraction elements and a person or a user in the context of a secondexemplary embodiment of a method according to the invention,

FIG. 6 shows an exemplary embodiment of a simulation environment havinga crane having a crane operator cab and a second image recording unitarranged therein,

FIG. 7 shows the arrangement of the second image recording unit in thecrane operator cab from FIG. 6 .

As already mentioned above, a method according to the invention or asimulation arrangement according to the invention for representing anenvironment by means of a display unit 2 arranged on a person 1 andvisible for the person 1 can particularly advantageously be used toteach persons 1 to deal with greatly varying devices or to test thereaction of the person 1 in greatly varying traffic situations and toteach the correct behavior in the respective situation.

FIGS. 1 to 4 show a schematic representation of a first exemplaryembodiment of a simulation arrangement according to the invention or amethod according to the invention in an interaction environment U, whichis a cockpit of an automobile. A number of actuatable interactionelements 3 a, 3 b are arranged in the interaction environment U. In thefirst exemplary embodiment, these are a steering wheel and brake,clutch, and gas pedals.

The simulation arrangement furthermore comprises in the first exemplaryembodiment a seat 6 and a control and processing unit 4. In the firstexemplary embodiment, a person 1 sits on the seat 6. This person 1,i.e., the user of the simulation, wears a display unit 2 arrangeable ona person 1, which in the first exemplary embodiment is a set of 3Dglasses for displaying display images C for the user, which is nottransparent. The display unit 2 displays a display image C for theperson 1 in the context of the simulation.

As schematically indicated in the first exemplary embodiment, thesimulation in the first exemplary embodiment is the most realisticpossible representation of a road traffic environment, in which the userof the simulation, i.e., the person 1, can have influence on thesimulation by means of the interaction elements 3 a, 3 b, which areconnected to the control and processing unit 4, and, for example, canvirtually move an automobile through a simulated virtual road trafficsituation.

A simulation arrangement according to the invention comprises at leastone first image recording unit 5, which is designed to create aninteraction environment recording A of at least parts of the interactionenvironment U at a respective recording point in time.

The simulation arrangement in the first exemplary embodiment comprisestwo first image recording units 5 a, 5 b, which are digital cameras.Alternatively thereto, for example, a stereo camera can also beprovided. The two first image recording units 5 a, 5 b are arranged inthe first exemplary embodiment on the person 1, i.e., specifically onthe display unit 2 which the person 1 wears. The recording area of thefirst image recording units 5 a, 5 b is oriented away from the head ofthe person 1 at the eye height of the person 1. If the person 1 movestheir head, the recording area of each of the first image recordingunits 5 a, 5 b changes and interaction environment recordings A of theinteraction environment U are provided in accordance with the respectiverecording area. The display unit 2, the interaction elements 3 a, 3 b,and the two first image recording units 5 a, 5 b are in datacommunication with the control and processing unit 4. This can beachieved, for example, via a wired, radio, or WLAN connection.

To provide the most realistic possible environment image B, for example,a virtual environment image of a road intersection, which corresponds tothe viewing angle from the position of the person 1 in the interactionenvironment U, the control and processing unit 4 first ascertains theposition of the person 1. This can take place with the aid of at leastone of the first image recording units 5 a, 5 b, which can compute arelative position, for example, on the basis of certain reference pointsin space, which is referred to as inside-out tracking. Alternatively,the position of the person 1 can, for example, be ascertained on thebasis of an external unit, for example a further image recording unit oran emitter for infrared light, for example, which can compute theabsolute position in space.

Subsequently, an image mask is provided for the creation of the displayimage C which is to be displayed by the display unit 2. For thispurpose, for example, at least one distance sensor can be arranged, forexample, on the person 1 or relative thereto, which measures thedistance of the person 1 to the interaction environment U, for exampleto one of the interaction elements 3 a, 3 b in the cockpit, andtransmits it to the control and processing unit 4.

In the first exemplary embodiment, such a distance sensor is integratedin the display unit 2. Alternatively thereto, the distance sensor can befastened in another way, for example, on the clothing of the person 1,or by means of a fixing belt, for example. Alternatively thereto, such adistance sensor can also be located in the immediate environment of theperson or can be installed adjacent to or above the person 1 in theinteraction environment U on a holding device.

If, as in the first exemplary embodiment, two first image recordingunits 5 a, 5 b are provided, alternatively thereto the control andprocessing unit can also ascertain these items of interactionenvironment distance information on the basis of the interactionenvironment recordings A provided by the first image recording unit 5 a,5 b. For this purpose, for example, a stereo superposition can becarried out of the RGB image data of the interaction environmentrecordings A provided by the two first image recording units 5 a, 5 b.

The control and processing unit 4 now establishes the position of theperson 1 in the interaction environment U and associates the items ofinteraction environment distance information with the individual imageareas of the interaction environment recording A.

Additionally or alternatively thereto, it is possible that the controland processing unit 4 ascertains at least one image parameter value ofthe individual image areas of the at least one interaction environmentrecording A position by position, i.e., for example, pixel by pixel.Such image parameter values are, for example, image sharpness value,brightness value, contrast value, or a color value.

This association of items of distance information and/or image parametervalues with image areas of the interaction environment recording A formsthe foundation for the creation of an image mask, which is used for thecreation of the display image C. The image mask is created here in sucha way that the depiction of the individual interaction elements 3 a, 3 bcontained in the at least one interaction environment recording A isrepresented in the display image C.

Individual positions on the interaction environment recording A, theenvironment image B, the image mask, and the display image C areassociated with one another so that the interaction environmentrecording A and the environment image B, when superimposed, result in adisplay image C that upon display by the display unit 2 is sharp, thusnot blurry, in the viewing center point of the display unit 2 and nodouble images are visible in this area. For this purpose, therecordings, for example, of the virtual and real environment, i.e., theinteraction environment recording A and the environment image B and theimage mask B, can advantageously be of equal size, so that theassociation or positioning of the individual image areas or pixels withone another is particularly simple. With arbitrary, also different sizesof the interaction environment recording A, the environment image B, andthe image mask B, the association of their individual image areas orpixels can be defined at least in such a way that the image center pointof the recordings or the image mask “occupies” the same position and thefurther positions can be computed therefrom. If necessary, the controland processing unit 4 can also additionally perform a correspondingequalization and/or continuing image data processing.

The image mask is thus used to define which image areas of theinteraction environment recording A and which areas of a providedenvironment image B are represented in the display image C, which isdisplayed to the person 1 by the display unit 2.

In simple terms, after application of the image mask, there are thusimage points or image areas in the interaction environment recording Aor the virtual or real environment image B, which are included by thisimage mask or which are among the set of the image points or image areasdefined by the image mask and are therefore visible for the person 1,and image points or image areas which are excluded from the image maskand are therefore not visible for the person 1.

The image mask can optionally also at least partially have apredetermined transparency here, which has the result that image pointsor image areas included by the image mask are incorporated with apredetermined weighting in the display image C.

The image mask can be created here, for example, by checking whether theobject area of the interaction environment U depicted in the respectiveimage area of the interaction environment recording A exceeds apredetermined interaction environment distance value. Such aninteraction environment distance threshold value can be stored, forexample, in the control and processing unit 4 before carrying out thesimulation.

If, as in the first exemplary embodiment, such an interactionenvironment distance threshold value is used for the creation of theimage mask, it is thus checked whether the individual image areas of theinteraction environment recording A are farther away than, for example,50 cm from the person 1. The image mask is thus provided in this case sothat those image areas of the interaction environment recording A, whichare farther than 50 cm away from the person 1, are not represented inthe display image C, while those image areas which are less than 50 cmaway are represented. In the display image C (see FIG. 4 ), thedepictions 3 a′ of the interaction element 3 a or the steering wheel,and the depictions of the dashboard, the rearview mirror, the sidemirrors, and parts of the automobile roof and the A-pillar of theinteraction environment U or the cockpit, and also the depictions of thehands of the person 1 are thus visible.

Additionally or alternatively thereto, it can be checked for thecreation of the image mask whether the respective image area of theinteraction environment recording A exceeds at least one image parameterthreshold value predetermined for the interaction environment U. Such animage parameter threshold value can be, for example, an image sharpness,brightness, contrast, or color threshold value and can be stored in thecontrol and processing unit 4 before carrying out the simulation.

If, for example, an image sharpness threshold value is used in thecreation of the image mask, it can thus be checked whether a respectiveimage area is represented sharply, so that only sharply depicted areasof the interaction environment U, which are located close to the person1, for example, are included in the display image C, while fuzzy areas,which are farther away, are not included in the display image C.

It is optionally also possible that, for example, a color thresholdvalue is used in the creation of the image mask, so that, for example,objects which have a specific color are not included in the displayimage C, or in particular objects which have a specific color arerepresented in the display image C. It is optionally also possible thatadditionally or alternatively thereto, a brightness and/or contrastthreshold value is used in the creation of the image mask, so that, forexample, objects which have a specific brightness or a predeterminedcontrast are not included in the display image C.

In order now, in the first exemplary embodiment, to display the mostrealistic possible traffic situation for the person 1 in the context ofthe simulation, an environment image B, as schematically shown in FIG. 3, is predetermined by the control and processing unit 4, adapted to theposition of the person 1. In the first exemplary embodiment, thisenvironment image B is a depiction of a virtual environment provided bythe control and processing unit 4. The environment image B in FIG. 3 is,for example, a virtual course of a road in a residential area.Alternatively thereto, an environment image B can also be predeterminedwhich originates from a real environment.

For the creation of the display image C, in principle at least oneinteraction environment recording A is superimposed with the providedenvironment image B using the image mask pixel by pixel to form a singleimage. If, as in the first exemplary embodiment, two interactionenvironment recordings A from two first image recording units 5 a, 5 bare available, these can be laid one on top of another, for example,using a common image mask or two separate image masks and twoenvironment images B so that two display images C are provided,specifically one for each eye of the user. That is to say, the mergingof the respective interaction environment recording A with therespective environment image B to form a display image C withapplication of the image mask can be carried out separately for eachimage recording unit 5 a, 5 b. Alternatively thereto, it is alsopossible that a single common interaction environment recording A iscreated from the recordings of both first image recording units 5 a, 5 band further processed.

Since the environment image B is ascertained in dependence on theposition of the person 1 in the interaction environment U and isoverlaid with a detail from the interaction environment recording A, aparticularly realistic display image C results for the person 1, asshown in FIG. 4 . If, as in the first exemplary embodiment, the hands ofthe person 1 and interaction elements 3 a, 3 b, such as the steeringwheel of the interaction environment U, are also visible, this helps theperson 1 in the spatial orientation during the simulation and gives theperson 1 the option of reacting deliberately to the traffic situationrepresented by the display unit 2. Therefore, in the first exemplaryembodiment not only a realistic simulation of a traffic situation isachieved, but also a realistic spatial perception is ensured, whichprevents the person 1 from feeling unwell during the simulation.

A second exemplary embodiment of a method according to the invention ora simulation arrangement according to the invention will be described onthe basis of FIGS. 5 to 7 . FIG. 5 shows a second exemplary embodimentof an interaction environment U, which is used, for example, to simulatethe operation of a crane from a crane operator cab.

As in the first exemplary embodiment, interaction elements 3 a, . . . ,3 d are arranged in the interaction environment U, which are shiftlevers and control buttons, as are required for operating a crane. Thesimulation arrangement furthermore comprises a seat 6, on which a person1 is schematically shown. The person 1 wears a display unit 2, which inthe second exemplary embodiment is a set of 3D glasses which displaysreceived display images C for the person 1. A single first imagerecording unit 5 is arranged on the display unit 2 at the height of theeye of the person. The first image recording unit 5 is a stereo camerain the second exemplary embodiment. Furthermore, the simulationarrangement in the second exemplary embodiment comprises a control andprocessing unit 4. As in the first exemplary embodiment, this is in datacommunication with the display unit 2 of the first image recording unitand the interaction elements 3 a, . . . , 3 d.

In the second exemplary embodiment, the simulation arrangement, forproviding the environment image C, additionally comprises a second imagerecording unit 51 arranged in a simulation environment S spatiallyseparated from the interaction environment U. The second image recordingunit 51 is designed to create at least one simulation environmentrecording, in which at least parts of the simulation environment S aredepicted. Since the second image recording unit 51 is a stereo camera inthe second exemplary embodiment, two simulation environment recordingsare provided, which are merged to form an environment image B of thesimulation environment S. The control and processing unit 4 is also indata communication with the second image recording unit 51.

As is apparent in FIG. 6 , the second image recording unit 51, whichsupplies simulation environment recordings for providing the environmentimage B, is really arranged in a crane operator cab Z of a crane X at aposition P₁. Alternatively thereto, it is also possible to place thesecond image recording unit 51 at another arbitrary position of thecrane, for example, at the position P₂ directly above the load to belifted.

FIG. 7 shows a schematic detail view of the arrangement of the secondimage recording unit 51 at the position P₁ in the simulation environmentS. The second image recording unit 51 is arranged in FIG. 7 on arotation and pivoting device at a height above the seat for a craneoperator which approximately corresponds to the height of the head of aperson 1 seated on the seat. The second image recording unit 51 isoriented in such a way that the recording area corresponds to theviewing direction of a person 1 seated on the seat out of the craneoperator cab Z. The simulation environment recording created by thesecond image recording unit 2 therefore contains depictions of thoseobjects and environment areas which are visible outside the craneoperator cab Z for a person 1.

In the exemplary embodiment of the simulation environment S in FIG. 6 ,this would be, for example, a view of the lifting cable and thesupporting means or load handling means of the crane and possibly a loadfastened thereon.

The control and processing unit of the simulation arrangement is also indata communication with the second image recording unit 51. This can beachieved, for example, via a radio or WLAN connection. For the creationof the display image C, the control and processing unit not onlyascertains, as in the first exemplary embodiment, the position of theperson 1 in the interaction environment U, but also the position of thesecond image recording unit 51 in the simulation environment S. Theascertainment of the position of the second image recording unit 51 cantake place here as described in the first exemplary embodiment for theposition of the person 1 in the interaction environment U.

The control and processing unit 4 activates the second image recordingunit 51 to provide an environment image B. In dependence on the positionof the person 1 in the interaction environment U and the position of thesecond image recording unit 51 in the simulation environment S, at leastone simulation environment recording is to be provided in such a waythat the recording areas of the first image recording unit 5 and thesecond image recording unit 51 are coupled to one another. In thiscontext, coupled means that the orientations of the first imagerecording unit 5 and the second image recording unit 51 are identical,so that, for example, when the person 1 turns their head in theinteraction environment U, a corresponding rotation is also executed bythe second image recording unit 51 in the simulation environment S.

Additionally to the interaction environment distance information betweenthe person 1 and the interaction environment U, an item of simulationenvironment distance information between the second image recording unit51 and the simulation environment S is ascertained. As in the firstexemplary embodiment, this can take place via a distance sensor which isarranged on the second image recording unit 51, or can be ascertained bycomputation by the control and processing unit 4 on the basis of thesimulation environment recording.

As in the first exemplary embodiment, these items of simulationenvironment distance information can be associated with the individualimage areas of the simulation environment recording for the creation ofthe image mask. Additionally or alternatively thereto, it is alsopossible, as in the first exemplary embodiment, that the control andprocessing unit 4 ascertains an image parameter value of the individualimage areas of the at least one simulation environment recordingposition by position, for example pixel by pixel, for the creation ofthe image mask.

The image mask is provided here, as described in the first exemplaryembodiment, in such a way that individual positions on the at least oneinteraction environment recording U, which the first image recordingunit 5 supplies, on the at least one simulation environment recording,which the second image recording unit 51 supplies, on the image mask,and on the display image C are associated with one another.

For the provision of the image mask, in addition to the steps in thefirst exemplary embodiment, for example, it is checked whether theobject area of the simulation environment S depicted in the respectiveimage area of the simulation environment recording exceeds apredetermined simulation environment distance value and additionally oralternatively thereto whether the respective image area of thesimulation environment recording exceeds an image parameter thresholdvalue predetermined for the simulation environment S.

For the creation of the display image C, which is displayed by thedisplay unit 2 for the person 1, in the second exemplary embodiment, theat least one interaction environment recording A and the providedenvironment image B, which originates from the simulation environment S,are superimposed pixel by pixel using the image mask.

In the second exemplary embodiment, for example, as in the firstexemplary embodiment, an interaction environment distance thresholdvalue is predetermined and for the creation of the image mask, that areaof the interaction environment U having the interaction elements 3 a, .. . , 3 d and the hands of the person 1 is displayed in the displayimage C, because the image areas which include these elements fall belowa distance threshold value predetermined for the interaction environmentU.

In the second exemplary embodiment, those image areas from theenvironment image B from the simulation environment S are used for thesupplementation to form a display image C, in which those areas of thesimulation environment S are depicted which exceed a distance thresholdvalue predetermined for the simulation environment S. This distancethreshold value predetermined for the simulation environment S can beadapted here to the distance threshold value predetermined for theinteraction environment U, so that in the display image C, those areasfrom the simulation environment S are shown which are, for example,farther than 50 cm away from the person 1. Thus, in the second exemplaryembodiment, the interaction elements 3 a, . . . , 3 d, i.e., the controllevers and knobs from the interaction environment U, are included in thedisplay image C, while the person 1 receives the impression of lookingout of the crane operator cab Z and controlling the crane X from thecrane operator cab Z.

In all embodiments of a simulation arrangement according to theinvention or a method according to the invention, multiple differentdistance sensors, which are based, for example, on different physicalmeasurement principles or are provided with different sensitivities,such as time-of-flight sensors, sensors for laser distance measurement,ultrasonic sensors, can be arranged, for example, on or relative to theperson 1 and/or the second image recording unit 51. In this case, forexample, each individual one of the sensors can create a distance imageof the interaction environment U or the simulation environment S.

In this case, the control and processing unit 4 can select that distancesensor for the provision of the distance information for the creation ofthe image mask, according to predetermined criteria, for example, independence on the time of day, the solar radiation, the ambientlighting, the surface quality, structure and reflectivity of therecorded objects, etc., which supplies the most reliable items ofdistance information in the present situation.

In this case, it is also possible that the items of distance informationprovided by multiple sensors are used as the foundation for the creationof an overall image mask. For the creation of such an overall imagemask, the items of distance information are processed, for example, byarithmetic functions and/or computer-based or electronics-based methodssuch as Kalman filters, neural networks, support vector machines, orcomputing a weighted average and assigned to the individual image areasof the interaction and/or simulation environment recordings, inparticular pixel by pixel.

As already mentioned above, the image parameter values which can be usedaccording to the invention for the creation of the image mask can be,for example, image sharpness, brightness, the contrast, or a colorvalue. For the creation of the image mask and to ascertain in a mannerwhich is particularly simple in terms of computing and time-savingwhether and to what extent the at least one interaction environmentrecording A and/or the provided environment image B are used for thecreation of the display image C, a threshold value comparison can becarried out. This also applies if items of distance information and adistance threshold value are used for the creation of the image mask.

The ascertainment of an image parameter value and the specification ofan image parameter threshold value are particularly advantageous ifobjects in the interaction environment recording A or the simulationenvironment recording are to be ascertained, the surfaces of which havea predetermined superficially recognizable property such as brightnessor color. The image areas to be displayed in the display image C canadvantageously be defined in this case in that those objects are eitherrepresented or excluded which correspond to these predetermined imageparameter criteria.

For the study as to whether an image area of the at least oneinteraction environment recording A or the simulation environmentrecording exceeds a respective predetermined distance threshold value,an envelope object can also be defined with respect to the interactionenvironment U and/or the simulation environment S. Such an envelopeobject can be defined, for example, with the aid of Boolean setoperations. For this purpose, for example, a function is defined whichis applied to each position or to each image value of a recording orenvironment in such a way that a result is provided for each value oreach position, which permits a statement about the display andrepresentation and representation form.

A display image C particularly realistic for the person 1, which isextensively free of undesired image edges and transitions, can beprovided if the control and processing unit 4 creates the display imageC, for example, using alpha blending. This is a procedure of scanning,which superimposes two colors or images in such a way that parts of theimages are laid one on top of another and mixed, so that the impressionresults that parts of one image would be transparent and let therespective other image show through. One example of this is thePorter-Duff algorithm.

The transparency of the image pixels within an overlay zone, which is ina predetermined distance area around the interaction environmentdistance threshold value or the simulation environment distancethreshold value, is predetermined, for example, according to apredetermined linear or exponential function. Directly at the interfaceat which the interaction environment recording A or the environmentimage B from the simulation environment S are merged to form a displayimage C, the transparency of both recordings can be set equal, forexample.

In image areas of the display image C which depict environment areaslocated spatially closer to the person 1, the transparency, for example,of the interaction environment recording A can be selected to be lowerthan the transparency of the environment image B from the simulationenvironment S. In those image areas which depict environment areasspatially farther away from the person 1, the transparency of theenvironment image B from the simulation environment S can be selected tobe lower than that of the interaction environment recording A.

In addition, the control and processing unit can also perform asmoothing of the image mask in the superposition area of the interactionenvironment recording A and the environment image B, so that the qualityof the display image C is increased further.

1-17. (canceled)
 18. A method for representing an environment by meansof a display unit disposed on a person and visible for the person as adisplay image in a context of a simulation, which comprises the stepsof: carrying out the simulation in an interaction environment, wherein aplurality of actuatable interaction elements is disposed in theinteraction environment and the simulation can be influenced by means ofthe interaction elements; creating at least one interaction environmentrecording depicting at least parts of the interaction environment bymeans of at least one first image recorder disposed on the person orrelative to the person; ascertaining a position of the person in theinteraction environment and an environment image from a virtual and/orreal environment being provided in dependence on the position of theperson; providing an image mask by: associating individual positions onthe at least one interaction environment recording, the environmentimage, the image mask, and the display image with one another;ascertaining an item of interaction environment distance informationbetween the person and the interaction environment and the interactionenvironment distance information is associated position by position,with individual image areas of the at least one interaction environmentrecording; and/or ascertaining at least one image parameter value of theindividual image areas of the at least one interaction environmentrecording position by position; creating the image mask such way that adepiction of individual ones of the interaction elements contained inthe at least one interaction environment recording is represented in thedisplay image by checking: whether an object area of the interactionenvironment depicted in a respective image area of the at least oneinteraction environment recording exceeds a predetermined interactionenvironment distance threshold value; and/or whether the respectiveimage area of the at least one interaction environment recording exceedsat least one image parameter threshold value predetermined for theinteraction environment; superimposing the at least one interactionenvironment recording and the environment image pixel by pixel using theimage mask; and displaying an image superimposed in this way as thedisplay image on the display unit.
 19. The method according to claim 18,wherein for a provision of the environment image: at least onesimulation environment recording depicting at least parts of asimulation environment is created by means of at least one second imagerecorder disposed in the simulation environment; wherein a position ofthe second image recorder in the simulation environment is ascertained;and wherein the environment image from the simulation environment isprovided in dependence on the position of the person and the position ofthe second image recorder such that recording areas of the first imagerecorder and the second image recorder are coupled to one another;wherein the image mask is provided in such a way that individualpositions on the at least one interaction environment recording, the atleast one simulation environment recording, the image mask, and thedisplay image are associated with one another, wherein: an item ofsimulation environment distance information between the at least onesecond image recorder and the simulation environment is ascertained andthe simulation environment distance information is associated withindividual image areas of the at least one simulation environmentrecording position by position; and/or at least one image parametervalue of the individual image areas of the at least one simulationenvironment recording is ascertained position by position; and whereinthe image mask is created by additionally checking: whether an objectarea of the simulation environment depicted in a respective image areaof the at least one simulation environment recording exceeds apredetermined simulation environment distance threshold value; and/orwhether the respective image area of the at least one simulationenvironment recording exceeds at least one image parameter thresholdvalue predetermined for the simulation environment; and wherein the atleast one interaction environment recording and the environment imagefrom the simulation environment are superimposed pixel by pixel usingthe image mask to create the display image.
 20. The method according toclaim 18, wherein the image mask is created in that the distanceinformation created position by position, and/or the image parametervalue ascertained position by position, is used to ascertain whetherand/or to what extent the at least one interaction environment recordingand/or the environment image are used for creation of the display image.21. The method according to claim 19, which further comprises:ascertaining the distance information on a basis of the interactionenvironment recording, and/or on a basis of the simulation environmentrecording; and/or ascertaining the distance information by means of adistance sensor disposed on the person, and/or on the second imagerecorder; and creating a distance image of the interaction environment,and/or the simulation environment by means of the distance sensor. 22.The method according to claim 21, wherein the distance sensor is one ofa plurality of different distance sensors; and which further comprisesperforming a change of the different distance sensors, the distanceinformation of which is used for a creation of the image mask, accordingto predetermined criteria.
 23. The method according to claim 22, whichfurther comprises using items of distance information provided by theplurality of different distance sensors as a foundation for a creationof an overall image mask.
 24. The method according to claim 19, whereinthe distance information is provided on a basis of the at least oneinteraction environment recording, and/or the simulation environmentrecording, by an algorithm which is based on technologies of machinelearning.
 25. The method according to claim 19, wherein the checking asto whether the object area of the interaction environment depicted inthe image area of the at least one interaction environment recording,and/or the object area of the simulation environment depicted in theimage area of the at least one simulation environment recording, exceedsa predetermined distance threshold value, and an envelope object isdefined with respect to the interaction environment, and/or thesimulation environment.
 26. The method according to claim 19, wherein:in the at least one interaction environment recording, and/or the atleast one simulation environment recording as the environment image fromthe simulation environment, depictions of objects are ascertained, asurface of which has a predetermined superficially recognizableproperty; and the depictions of the objects ascertained in this way arenot used for a superposition of the at least one interaction environmentrecording and the environment image.
 27. The method according to claim18, wherein: a superposition zone is predetermined in a predetermineddistance area around a predetermined distance threshold value, and upona superposition of the at least one interaction environment recordingand the environment image, a transparency of image points of the atleast one interaction environment recording and the environment imagewhich depict the object areas within the superposition zone, ispredetermined; and it is provided that the object points of the at leastone interaction environment recording and the environment image, whichform object areas, a distance of which corresponds to the distancethreshold value, are predetermined to be equally transparent upon thesuperposition.
 28. The method according to claim 18, wherein the imagemask is smoothed in a superposition area of the at least one interactionenvironment recording and the environment image, so that individualpixel values of the image mask define a ratio in which relevant pixelvalues of the at least one interaction environment recording and theenvironment image are superimposed on one another.
 29. The methodaccording to claim 19, wherein an exposure and/or f-stop of the firstimage recorder and/or the second image recorder is adapted to objects, adistance of which exceeds a predetermined distance threshold value. 30.The method according to claim 18, wherein: the display unit includes aset of 3D glasses to display the display image; the interactionenvironment is a cockpit; the at least one interaction environmentrecording is two interaction environment recordings; the interactionenvironment distance information is associated pixel by pixel with theindividual image areas of the at least one interaction environmentrecording; the at least one image parameter value is an image parametervalue selected from an image sharpness value, a brightness value, acontrast value, or a color value; and the at least one image parameterthreshold value is selected from an image sharpness threshold value, abrightness threshold value, a contrast threshold value, or a colorthreshold value.
 31. The method according to claim 19, wherein: the atleast one simulation environment recording is two simulation environmentrecordings; the simulation environment distance information isassociated with the individual image areas of the at least onesimulation environment recording pixel by pixel; and/or the at least oneimage parameter value is selected from an image sharpness value, abrightness value, a contrast value, and a color value, and theindividual image areas of the at least one simulation environmentrecording is ascertained pixel by pixel; and the at least one imageparameter threshold value is selected from a image sharpness thresholdvalue, a brightness threshold value, a contrast threshold value, and acolor threshold value.
 32. A simulation configuration for representingan environment as a display image in a context of a simulation, thesimulation configuration comprising: a display unit disposable on aperson being configured to display received display images for theperson; an interaction environment; a plurality of actuatableinteraction elements disposed in said interaction environment, whereinthe simulation is influenceable by means of said interaction elements;at least one first image recorder disposable on or relative to theperson, and configured to create at least one interaction environmentrecording at least of parts of the interaction environment at arespective recording point in time; and a control and processing unit indata communication with said display unit and said at least one firstimage recorder, said control and processing unit configured: toascertain a position of the person in said interaction environment andprovide an environment image from a virtual and/or real environment independence on the position; to activate said at least one first imagerecorder to create interaction environment recordings; to ascertain orprocess an item of distance information between the person and saidinteraction environment and to associate the distance information withindividual image areas of the at least one interaction environmentrecording position by position and/or to ascertain at least one imageparameter value of the individual image areas of the at least oneinteraction environment recording position by position; and to create animage mask such that a depiction of individual ones of said interactionelements contained in the at least one interaction environment recordingis represented in the display image by checking: whether an object areaof the interaction environment depicted in a respective image area ofthe at least one interaction environment recording exceeds apredetermined interaction environment distance threshold value; and/orwhether the respective image area of the at least one interactionenvironment recording exceeds the at least one image parameter thresholdvalue predetermined for the interaction environment; to associateindividual positions on the at least one interaction environmentrecording, the environment image, the image mask, and the display imagewith one another; to superimpose the at least one interactionenvironment recording and the environment image pixel by pixel using theimage mask; and to transmit an image superimposed in this way as thedisplay image to said display unit.
 33. The simulation configurationaccording to claim 32, further comprising at least one second imagerecorder disposed in a simulation environment and configured to createat least one simulation environment recording depicting at least partsof the simulation environment, wherein said control and processing unitis in data communication with said second image recorder; and whereinsaid control and processing unit further configured: to ascertain aposition of said second image recording unit in the simulationenvironment; to activate said at least one second image recorder toprovide the environment image from the simulation environment independence on the position of the person in said interaction environmentand the position of said second image recorder such that recording areasof said at least one first image recorder and said at least one secondimage recorder are coupled to one another; to ascertain or process anitem of distance information between said at least one second imagerecorder and the simulation environment and to associate the distanceinformation with the individual image areas of the at least onesimulation environment recording position by position and/or toascertain at least one image parameter value of the at least onesimulation environment recording position by position; and to create theimage mask by additionally checking: whether an object area of thesimulation environment depicted in a respective image area of the atleast one simulation environment recording exceeds a predeterminedsimulation environment distance threshold value; and/or whether therespective image area of the at least one simulation environmentrecording exceeds at least one image parameter threshold valuepredetermined for the simulation environment; to associate individualpositions on the at least one interaction environment recording, thesimulation environment recording as an environment image, the imagemask, and the display image with one another; and to superimpose the atleast one interaction environment recording and the environment imagefrom the simulation environment pixel by pixel using the image mask tocreate the display image.
 34. The simulation configuration according toclaim 33, further comprising at least one distance sensor disposable onthe person and/or said first image recorder, said at least one distancesensor is configured to create a distance image of the interactionenvironment and/or the simulation environment.
 35. The simulationconfiguration according to claim 32, further comprising a plurality ofdifferent distance sensors, and said control and processing unit isconfigured to select a distance sensor from said plurality of differentdistance sensors for providing distance information for a creation ofthe image mask according to predetermined criteria.
 36. A simulationconfiguration for representing an environment as a display image in acontext of a simulation, the simulation configuration comprising: adisplay unit disposable on a person being configured to display receiveddisplay images for the person; an interaction environment; a pluralityof actuatable interaction elements disposed in said interactionenvironment, wherein the simulation is influenceable by means of saidinteraction elements; at least one first image recorder disposable on orrelative to the person, and configured to create at least oneinteraction environment recording at least of parts of the interactionenvironment at a respective recording point in time; and a control andprocessing unit in data communication with said display unit and said atleast one first image recorder, said control and processing unitconfigured: to ascertain a position of the person in said interactionenvironment and provide an environment image from a virtual and/or realenvironment in dependence on the position; to activate said at least onefirst image recorder to create interaction environment recordings; toascertain or process an item of distance information between the personand said interaction environment and to associate the distanceinformation with individual image areas of the at least one interactionenvironment recording position by position and/or to ascertain at leastone image parameter value of the individual image areas of the at leastone interaction environment recording position by position; and tocreate an image mask such that a depiction of individual ones of saidinteraction elements contained in the at least one interactionenvironment recording is represented in the display image by checking:whether an object area of the interaction environment depicted in arespective image area of the at least one interaction environmentrecording exceeds a predetermined interaction environment distancethreshold value; and/or whether the respective image area of the atleast one interaction environment recording exceeds the at least oneimage parameter threshold value predetermined for the interactionenvironment; to associate individual positions on the at least oneinteraction environment recording, the environment image, the imagemask, and the display image with one another; to superimpose the atleast one interaction environment recording and the environment imagepixel by pixel using the image mask; to transmit an image superimposedin this way as the display image to said display unit; and to carry outthe method according to claim
 18. 37. The simulation configurationaccording to claim 32, wherein: said display unit is a set of 3Dglasses; said interaction environment is a cockpit; an association ofthe distance information with the individual image areas of the at leastone interaction environment recording is performed pixel by pixel; theimage parameter value is selected from the group consisting of: an imagesharpness value, a brightness value, a contrast value, and a colorvalue; and the at least one image parameter threshold value is selectedfrom the group consisting of: an image sharpness threshold value, abrightness threshold value, a contrast threshold value, and a colorthreshold value.